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Abstract: Joint effect of weak bircfringent disorder and amplifier 
noise on transmission in optical fiber communication systems appears 
to be strong. The probability of an extreme outage that corresponds to 
anomalously large values of Bit Error Rate (BER) is perceptible. We 
analyze the dependence of the Probability Distribution Function (PDF) 
of BER on the first-order and also higher-order PMD compensation 
schemes. 
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Introduction: Polarization Mode Dispersion (PMD) is recognized to be a substan- 
tial impairment for optical fiber systems with the 40-Gbs/s and higher transmission 
rates. One may not have a complete control of PMD since the fiber system birefrin- 
gence is changing substantially under the influence of environmental condition (e.g., 
stresses and temperature) fluctuations, see e.g. [1, 2]. Thus, dynamical PMD compen- 
sation became a major issue in modern fiber optics communication technology [3, 4]. 
Development of experimental techniques capable of the first- [5, 6, 7] and higher-orders 
[7, 8] PMD compensation have raised a question of how to evaluate the compensation 
success (or failure). Traditionally, the statistics of the PMD vectors of first [9, 10, 11] 
and higher orders [12, 13, 14] is considered as a measure for any particular compensation 
method performance. However, these objects arc only indirectly related to what actu- 
ally represents the fiber system reliability. In this letter we show that the PMD effects 
should be considered jointly with impairments due to amplifier noise, since fluctuations 
of BER caused by variations of the birefringent disorder, are substantial. We demon- 
strate that probability of extreme outages is much larger than one could expect from 
naive estimates singling out effects of either of the two impairments. This phenomenon 
is a consequence of a complex interplay between the impairments of different natures. 
(Birefringent disorder is frozen, i.e. it does not vary on all propagation related time 
scales, while the amplifier noise is extremely short-correlated.) The effect may not be 
explained in terms of just an average value of BER, or statistics of any PMD vectors of 
different orders, but rather should be naturally described in terms of the PDF of BER, 
and specifically its tail. A consistent theoretical approach to calculating the tail will 
be explained briefly, with a prime focus on the analysis of the first- and higher-order 
compensation effects on the extreme outages measured in terms of the PDF of BER. 

Bit-Error-Rate: We consider the so-called return-to-zero modulation format, when 
pulses (information carriers) are well separated in time, t. The quantity measured at 
the output of the optical fiber line is then pulse intensity: 



where G(t) is the convolution of the electrical (current) filter function with the sampling 
window function. The two-component complex field \P(Z,t) describes the output signal 
envelope. The two components correspond to two polarizations of the optical fiber mode. 
The linear operator fC in Eq. (1) stands for a variety of engineering "tricks" applied 
to the output signal. They consist of the optical filter JCf, and the compensation JC C 
parts, respectively, assuming the compensation is applied first followed by filtering, 
i.e. JC = JCf x JC C . Ideally, / accepts two different values depending on whether the 
information slot is vacant or filled. However, the impairments enforce deviations of / 
from the fixed values. Therefore, one has to introduce a threshold (decision level) Id and 
declare that the signal encodes "1" if / > Id and is related to "0" otherwise. Sometimes 
the information is lost, i.e. an initial "1" is detected as a "0" at the output or vise versa. 
BER is the probability of such "error" event (with statistics being collected over many 
pulses coming through a fiber with a given realization of birefringent disorder). For 
successful system performance the BER must be extremely small, i.e. both impairments 
typically cause only small distortions to a pulse. It is straightforward to verify that 
anomalously high values of BER originate solely from the "1 — ► 0" events. We denote 
the probability of such events by B. Non-zero B are caused by the noise, the values, 
however, depending on particular realization of the birefringent disorder. 

Noise averaging: We consider the linear propagation regime, when the output 
signal can be decomposed into two contributions: tp, related to a noiseless initial 
pulse evolution and the noise-induced (p part of the signal. <fi appears to be a zero-mean 




(1) 



Gaussian variable (insensitive to a particular birefringence and chromatic dispersion in 
the fiber) and is completely characterized by the pair correlation function 



{<f> a (Z,ti)4>}(Z, t 2 )) = D^ZSapSih - t 2 ). 



(2) 



Here, Z is the total length of the fiber line, and the product D^Z is the amplified 
spontaneous emission (ASE) spectral density accumulated along the line. The coefficient 
Z?£ is introduced into Eq. (2) to reveal the linear growth of the ASE factor with Z [15]. 
Disorder averaging: The noise-independent part of the signal is 



where S*b(i)j V — fo^ z d(z), z, and d(z) are the input signal profile, the integral chro- 
matic dispersion, coordinate along the fiber, and the local chromatic dispersion, respec- 
tively. The ordered exponent U depends on the 2x2 matrix rh(z) that characterizes 
the birefringent disorder. The matrix can be represented as rh = hjbj, hj(z) being a 
real three-component field and bj the Pauli matrices. Averaging over many states of 
the birefringent disorder any given fiber is going through (birefringence varies on a time 
scale much longer than any time scale related to the pulse propagation through the 
fiber), or over instant states of birefringence in different fibers, one finds that hj(z) is a 
zero-mean Gaussian field described by the following pair correlation function 



If birefringent disorder is weak the integral H = L dzh(z) coincides with the PMD 
vector. Thus, D m = fc 2 /12, where k is the so-called PMD coefficient. 

PDF of BER is the proper object to describe fluctuations of B caused by the 
birefringent disorder. For successful fiber system performance the BER should be ex- 
tremely small, i.e. typically both impairments can cause only small distortions of a 
pulse. Stated differently, the optical signal-to-noise ratio (OSNR) and the ratio of the 
squared pulse width to the mean square value of the PMD vector are both large. OSRN 
can be estimated as Iq/{D^Z) where I = J dt |^ (i)| 2 is the initial pulse intensity, 
and the integration goes over a single slot populated by an ideal (initial) pulse, encod- 
ing "1". Since the value of OSNR is large averaging over the noise can be performed 
using the saddle-point method. This leads to a conclusion that D^ZlnB depends on 
the birefringence, shape of the initial signal and the details of the compensation and 
measurement procedures, being, however, independent of the noise. Typically, B fluc- 
tuates around Bo, the zero-disorder, hj = 0, value of B. For any finite value of h one 
gets, \n(B/B ) = TIo/(D^Z), where the dimensionless factor T depends on h. Since the 
noise is weak, even small disorder can generate strong increase in B. This implies that a 
perturbative calculation of T based on expanding the ordered exponent U in Eq. (3) in 
powers of rh, describes the most essential part of the PDF of B. Thus, in the situation 
when no compensation is applied one derives T = jjbiH^/b, whereas in the simplest case 
of the "setting the clock" compensation, accounting for the average (typical) tempo- 
ral shift, one arrives at T = n 2 (H 2 + H 2 )/b 2 , b being the pulse width and /iti^ being 
dimensionless coefficients. 

Long tail: The PDF of B, S(B) (that appears in the result of averaging over many 
realizations of the birefringent disorder) can be found by recalculating the statistics of 
Hj using Eq. (4) followed by substituting the result into the corresponding expression 
that relates B to Hj . Our prime interest is to describe the PDF tail that corresponds to 
the values of Hj substantially exceeding their typical value \/D m Z remaining, however, 





(h i (z 1 )h j (z 2 )) = D m S lj S(z 1 - z 2 ). 



(4) 



much smaller than the signal duration b. In this range one gets the following estimates 
for the differential probability S(B) dB: 



a) exp 



2D m fi 1 I \B t 



dB BgdB 



where (a) corresponds to the no-compensation situation, (b) stands for the optimal 
"setting the clock" case, and a = D(b 2 / (2/i2-D TO Jo). Note, that the result in the case 
(b) shows a steeper decay compared to the case (a), which is a natural consequence of 
the "setting the clock" compensation. 

PMD compensation: One deduces from Eqs. (1,3) that the output intensity de- 
pends on the birefringent disorder via the factor K.JJ . The idea of the compensation 
can be restated in a more formal way as building a linear operator K, c that suppresses 
the dependence of JC C U on h. The so-called first-order compensation K, c = K,\ 

JCi = exp ^— J dz hjdjdt \ , (6) 

boils down to compensating the first term in the expansion of the ordered exponential 
U in h [12, 13, 14]. Technically, this is achieved by sending the signal aligned with either 
of the two principal polarization states of the fiber [5], or inserting a PMD controller 
(a piece of polarization maintaining fiber with uniformly distributed well-controlled 
birefringence) at the receiver [6]. Expanding JC\U in h followed by substituting the 
result into Eq. (1) and evaluating B leads to 

r = (fA/b) 2 [ dz' [ dz [h l {z')h 2 {z)-h 2 {z')h l {z)] , (7) 
Jo Jo 

b being the pulse width, and only the leading 0(h 2 ) term is retained in Eq. (7). The 
dimcnsionless coefficient fj, 2 is related to the output signal chirp, produced by the ini- 
tial signal chirp and/or the nonzero integral chromatic dispersion rj. Recalculating the 
statistics of T using Eqs. (4,7) one obtains the following tail S(B) for the PDF of B 

„, . 1 B^dB irDtb 2 

and Eq. (8) holds when \n(B/B ) > \fj,' 2 \D m I /[D i b 2 ). 

Non-chirped signal: If the output signal is not chirped \j! 2 = and the first non- 
vanishing term in the expansion of T in hj is of the third order. Expanding KL\U up to 
the leading (third order) term yields 



r = 



dzi J dz 2 j dz 3 ^2h 3 (zi)n(z2,z 3 )-h 3 (z 2 )H(z 1 ,z 3 )-h 3 (z 3 )n(zi,Z2)Y (9) 



with T~C(zi,Z2) — hi(zi)hi(z2) + h 2 (zi) h^iz^)- Substituting Eq. (9) into the expression 
for B in terms of T and making use of Eq. (4) leads to a representation of the PDF of B 
as a path-integral over h. Integrating over h 3 explicitly and approximating the resulting 
integral over hi t 2 by its saddle-point value, one finds the PDF tail 

lnS ^ 4 ,(M^LJLf. (10) 



0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 

X 



Fig. 1. Dependence of To = —D^zlnBo/Io, Ml, M2, V^/P an d on T, t, for the 
model explained in the text. All quantities are measured in the units corresponding 
to the pulse width and amplitude both equal to one. 

Eq. (10) is valid at D^Zhx(B/B ) > ^{D m Zf' 2 I /b 3 . 

Simple model: The dimensionless coefficients (j/ 2 , /i3 can be computed in the frame- 
work of a simple model, with the decision level threshold Id being twice smaller than the 
ideal intensity, the Lorentzian profile of optical filter, K-f^f = f Q dt' exp[— i/V]*^— i')/r, 
and the step function form for G, G(t) = 6(T— \t\). We also consider a Gaussian weakly- 
chirped initial signal ot exp(— t 2 /[2b 2 })(l + if3 in t 2 /b 2 ), fi in <C 1 (here both the sig- 
nal amplitude and its width are re-scaled to unity). The output signal chirp becomes 
= Pin + ">]> V being the integral dimensionless chromatic dispersion. Then, n' 2 is pro- 
portional to /3, and the slope fJ,' 2 / (3, found from the saddle-point equations numerically, 
along with corresponding values of Tq = —D^zIuBq/Io and ^1,2,3 are shown in Fig. 1 
for a reasonable range of the parameters T, r (measured in the units of the pulse width 
b). 

Advanced compensation: The fiber system performance can be improved even 
further. First of all, special filtering efforts can enforce the output pulse symmetry under 
the t — > — t transformation. Then the 0(H 3 ) contribution to T will also be cancelled out 
and Eq. (9) will be replaced by T = 0(H 4 ). Second, one can use a more sophisticated 
compensation K, c aiming to cancel as much terms in the expansion of K. C U in h as possi- 
ble. This approach corresponds to the so-called high-order compensation techniques im- 
plemented experimentally in many modern setting (see e.g., [7, 8]). The high-order com- 
pensation can substantially reduce the dependence of T on h, leading to T ~ /j, k (H/b) k 
(where k exceeds by one the compensation degree if no additional cancellations occur). 
In this case the tail of the PDF of V is estimated by exp[-(6 2 / D m Z){T / ^ k ) 2/k \- This 
results in the following expression for the tail of the PDF of B, 



In 5 ~ -(b 2 /D m Z)^ 1 D 6 Z]n(B/B )/I ] 2 / k , 



(11) 



valid for D^Zln(B/B ) > {D m Z/fi k b 2 ) k / 2 I Q . Eq. (11) generalizes Eqs. (8,10). One 
concludes that, as anticipated, the compensation does suppress the PDF tail. One also 
finds the outage probability O, defined as O = J B dBS(B) (with B* being some fixed 

value much larger than B ), lnO [(fj lk I )- 1 D ( Z ln(B*/B )] 2/k b 2 /(D m Z). 

Example: Summarizing, our major result is quantitative description of the sup- 
pression of the extremely long tail in the PDF of BER. We find it useful to conclude 
with presenting a numerical example that corresponds to a case relevant for the opti- 
cal fiber communications. Consider a fiber line with r = 0.06, fii = 0.06, fj,2 = 0.12, 
fj/ 2 = 0.15 and /13 = 0.35, which is also characterized by typical bit-error probability, 
B = 10~ 12 that corresponds to I /[D^Z] m 460. We also assume that the PMD coeffi- 



cient, k = y/12D m , is 0.2 ps/Vkrn, the pulse width is b = 25 ps, and the system length 
is Z = 2, 500 km, i.e. D m Z/b 2 m 0.013. Then the outage probability corresponding to 
B„ = 10 -10 , that is the probability for B to be at least 2 orders of magnitude larger 
than Bq, is O ss 0.35 if no compensation is applied, see Eq. (5a), while one derives 
O f» 0.04, O w 4 • 10~ 4 and O f» 2 ■ 10~ 13 for Eq. (5b), Eq. (8) and Eq. (10), describing 
the cases of the "setting the clock" , first- and second-order compensations, respectively. 
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